Closed Bug 1098069 Opened 11 years ago Closed 2 months ago

Constant Freezing for minutes with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder. Workaround unselect the checkbox "Search Online" in unified folder properties. (imap)

Categories

(MailNews Core :: Backend, defect)

Product:
MailNews Core
Component:
Backend
Platform:
x86_64
All
Type:
defect

Tracking

(thunderbird_esr115 affected)

Status:
RESOLVED WORKSFORME
Tracking Flags:
Tracking Status
thunderbird_esr115 --- affected

People

(Reporter: old.square.eyes, Unassigned)

References

(Blocks 2 open bugs)

Details

(Keywords: perf, Whiteboard: [needs profile performance for 128][has 115 performance profile])

Attachments

(1 file)

Screenshot 2014-10-29 10.26.24.png
116.24 KB, image/png
Details
User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:33.0) Gecko/20100101 Firefox/33.0 Build ID: 20141106120505 Steps to reproduce: Thunderbird 31.2 freezes constantly with the spinning Windows 7 wheel and "(Not responding)" in the title bar, and often times with "Searching folder" in the bottom notification area. I have 3 IMAP acounts, one Gmail, and two self hosted. I have.... :: Unchecked "Enable Global Search and Indexer" from advanced settings :: Set each each set to sync only 120 days :: Not download messages over 50kb :: Unsubscribed from the "All mail folder" :: Tried a fresh install of Thunderbird, but I also used to have this problem on OSX so it must be something to do with my Google account or a much wider problem :: Followed Google's own Thunderbird recommended optimizations https://support.google.com/mail/answer/78892?hl=en Starting with add-ons disabled makes no difference. But taking it off unified folder view seems to help a little. I still get way too many spinning wheels, but at least it doesn't lock up. Actual results: Thunderbird freezes and locks up for minutes at a time. I can't click anywhere untill it finished whatever it's doing. Expected results: I expect Thunderbird not to freeze up all the time. It's unusable. I love Mozilla and their support for privacy. But if it's unusable I can't use it:(
Severity: normal → major
Just wanted to add that I moved back to OSX 10.10.1, Thunderbird 31.1, and am having the same problem. The freezes are still there, and the app locks up with "searching folder" in the title bar. It usually happens when clicking on Thunderbird in the dock. It's as if bringing the app into focus triggers a query to the IMAP server, which is fine, but I don't believe all other functions of the app should lock up. Clicking anywhere in the window produces the Mac spinning beach ball, until whatever process finishes. It seems shorter on the Mac (about 15 seconds), but maybe it's because I have gotten used to leaving the app and coming back a minute or so later.
Do you have Time Machine enabled and running on the Mac? If not ... 1. Please start Thunderbird with logging enabled to capature an example time frame using ImapAutoSync:5,imap:5,msgdb:1,timestamp per https://wiki.mozilla.org/MailNews:Logging 2. And is it predictable _enough_ that, in say 5 attempts, you can capture one example with profiler enabled? https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G
Blocks: tb-gmailWIP
Flags: needinfo?(old.square.eyes)
I do have time machine, but my backup hard drive is not always connected. This happens then too. Do you still want me to do 1 & 2 above?
Flags: needinfo?(old.square.eyes)
Yes please
Flags: needinfo?(old.square.eyes)
Keywords: perf
Summary: Constant Freezing “Searching Folder” → Constant Freezing “Searching Folder” in status bar when using unified folders
Can you explain #1 a bit better? What would my .command file look like? This?... #!/bin/sh export NSPR_LOG_MODULES=imap:5 export NSPR_LOG_FILE=$HOME/imap.log /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin & if on 10.5 change the above line to arch -arch i386 /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin & ImapAutoSync:5,imap:5,msgdb:1,timestamp Also for number two, I have captured an instance of the freeze with the Gecko Profiler. Is any personal data collected? Should I PM that to you?
Flags: needinfo?(old.square.eyes)
1. looks good. except you want ImapAutoSync:5,imap:5,msgdb:1,timestamp 2. profiler has no personal data
I have emailed you the link to #2
As for #1 I have created the file, set the permissions, and run it. It opens Thunderbird, but I can't see where to grab the logged info.
OK I found the log file in my user folder. I emailed that to you as well.
Thanks for the info. However, it is lacking in two ways: 1. I see only an imap protocol. Perhaps I gave you bad advice. Your export needs to be ImapAutoSync:5,imap:5,msgdb:4,timestamp 2. The profile run is missing symbols, so I think you may need to use a nightly build from https://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-comm-central/ Backup your profile before using the nightly. And, make sure time machine is not running.
Flags: needinfo?(old.square.eyes)
#!/bin/sh export NSPR_LOG_MODULES=imap:5 export NSPR_LOG_FILE=$HOME/imap.log /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin & if on 10.5 change the above line to arch -arch i386 /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin & ImapAutoSync:5,imap:5,msgdb:1,timestamp Is what I used. That log file was the only one that was created.
Flags: needinfo?(old.square.eyes)
Let us know when you have data according to comment 10 data from comment 11... profile: http://people.mozilla.org/~bgirard/cleopatra/?1423015041220#report=291702c1def9926c2f83c8a1b5527542827d3ce3&selection=0,1,7 partial log... 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 12 getquotaroot "INBOX" 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=24 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * QUOTAROOT "INBOX" "" 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=39 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * QUOTA "" (STORAGE 4625131 15728640) 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=15 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: 12 OK Success 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 13 UID fetch 42349:* (FLAGS) 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=58 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * 36862 FETCH (UID 42348 MODSEQ (4208742) FLAGS (\Seen)) 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=15 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: 13 OK Success 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 14 uid SEARCH UNDELETED 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1] 626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=215335 needmore=0] 626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 3561 3587 3593 3594 3602 3604 3605 3606 3609 3616 3632 3635 3641 3642 3643 3648 3649 3650 3652 3657 3659 3668 3669 3670 3690 3693 3699 3705 3709 3721 3725 3727 3731 3739 3740 3741 3743 3756 3766 3767 3772 3775 3780 3786 3793 3794 3795 3798 3806 3814 3817 3822 3825 3826 3832 3834 3850 3851 3854 3866 3868 3869 3873 3874 3881 3885 3909 3910 3911 3929 3930 3931 3935 3944 3948 3949 3964 3968 ... continues for about 500 lines like the line above
Component: Search → Networking: IMAP
Flags: needinfo?(old.square.eyes)
Product: Thunderbird → MailNews Core
Summary: Constant Freezing “Searching Folder” in status bar when using unified folders → Constant Freezing for minutes at a time with “Searching Folder” in status bar when using unified folders with gmail account
(In reply to Wayne Mery (:wsmwk) from comment #12) > data from comment 11... No timestamp, even though you are analyzing performance relevant issue... > 13 UID fetch 42349:* (FLAGS) Oh, CONDSTORE is not disabled... > 14 uid SEARCH UNDELETED I didn't know Tb uses SEARCH UNDELETED... > * SEARCH 3561 > 3587 3593 3594 3602 3604 3605 3606 3609 3616 3632 3635 3641 3642 3643 3648 > (snip) > 3869 3873 3874 3881 3885 3909 3910 3911 3929 3930 3931 3935 3944 3948 3949 > continues for about 500 lines like the line above Vary many UIDs in single response... How many mails do you keep in Inbox of the Gmail IMAP account? "Searching..." is perhaps corresponds to this "uid SEARCH UNDELETE". And, ""Searching... is shown for lng time" indictes that it takes long to process SEARCH UNDELETE response. I don't know when Tb issues "uid SEARCH UNDELETED". But "uid SEARCH UNDELETED" is perhaps a result of "SELECT Inbox + uid fetch 1:* Flags (CHANGEDSINCE known_modseq)" used by CONDSTORE support. If CONDSTORE support is disabled, Tb uses "SELECT Inbox + uid fetch 1:* Flags". In this case, "one UID per a response line", so lo---ng single response won't occur, and because "known UID is actually existing, and unknown UD is actually non-existent" is guranteed by full resync after SELECT, Tb perhaps never uses "uid SELECT UNDELETE". As known by bug 912216, Tb's CONDSTORE support has problems. Disable CONDSTORE support. Does problem still occur?
If parsing of SELECT UNDELETED response is simply "get Next token, then append to mutableArray" + "finally sort" like one, performance problem usually won't occur. I guess issue like ""get Next token, then append to mutableArray, and tries to keep ascending order upon each append, so sort is done for each append of a UID". It may be similar issue to bug 872869. Why "uid SEARCH UNDELETE".is issued may be "Unified Folder==Search Folder(Virtual Folder)" and "partial resync due to CONDSTORE support". .
I do have a lot of emails in my inbox (doesn't everyone?), and I also use labels (six, not including the gmail defaults). I see there is a patch on the other link. How do I run this to disable CONDSTORE? Interesting though don't you think that things are much quicker with unified inbox off?
Flags: needinfo?(old.square.eyes)
"writing bug number in comment at B.M.O" means "read pointed bug, please" frequently. Have you "*read*" pointed bugs?.
Following is imap log for "Unified Folder" open and "Search Folder" open. As for "SELECT UNDELED" command use, no difference was observed between "Saved Search Folder" and "Unified Folder". (a) Saved Search Folder : Search Target = Inbox of 2 imap accounts : imap.mail.yahoo.com, imap.gmail.com Condition = Match All, "Online Search" option : Checked (b) Unified Folder named Inbox : Search Target = Inbox of all IMAP accounts + Inbox of all non-IMAP mail account Condition = Match All, "Online Search" option = Grayed out. Not checked status. (it seems that Tb always uses Online Search when Unified Folder) If Online Search of Search Folder, usually "not Match All" and other modifier such as "KEYWORD $label1" is added("Tag contains Important" case), so not so many UID is returned to SEARCH commnd. There was no difference between "CONDSTORE is enabled" and "CONDSTORE is disabled". CONDSTORE is relevant to "CHANGEDSINCE is used or not" upon "uid fetch 1:* Flags" for resync after SELECT Mbox. > 00000003 8:51:01.077 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:SendData: 6 uid SEARCH UNDELETED > 00000004 8:51:01.327 [2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=1639 needmore=0] > 00000005 8:51:01.327 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 285 287 288 289 290 293 359 429 430 433 434 500 1121 1132 1136 1142 1143 1146 1150 1157 1168 1179 1189 1202 1204 1206 1208 1209 1212 1213 1214 1215 1216 1217 1218 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1232 1233 1234 1235 1236 1237 1238 1239 1240 1242 1243 1244 1245 1258 1259 1260 1261 1262 1266 1272 1281 1288 1292 1294 1296 1301 1314 1460 1850 1851 1852 1853 1854 1855 185 > 00000006 8:51:01.327 [2812] 3144[1013d60]: 6 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1876 1877 1878 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 194 > 00000007 8:51:01.327 [2812] 3144[1013d60]: 0 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 202 > 00000008 8:51:01.327 [2812] 3144[1013d60]: 4 2025 2026 2027 2028 2029 2030 2031 2032 2033 2078 2088 2117 2130 2150 2151 2181 2297 2372 2383 2384 2385 2386 2396 2397 2400 2401 2402 2403 2404 2405 2406 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 246 > 00000009 8:51:01.327 [2812] 3144[1013d60]: 5 2466 2467 2468 2469 2470 2471 2472 > 00000010 8:51:01.327 [2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=27 needmore=0] > 00000011 8:51:01.327 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: 6 OK UID SEARCH completed > > 00000017 8:51:01.327 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:SendData: 25 uid SEARCH UNDELETED > 00000018 8:51:01.562 [2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=806 needmore=0] > 00000019 8:51:01.562 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 > 00000020 8:51:01.562 [2812] 3656[1012320]: 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 > 00000021 8:51:01.562 [2812] 3656[1012320]: 1047 > 00000022 8:51:01.562 [2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=34 needmore=0] > 00000023 8:51:01.562 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: 25 OK SEARCH completed (Success) Yahoo! imap looks to insert new line at "where he wants" instead of "between two UIDs as done by Gmail imap". Do you see your problem with following? (1) Disable CONDSTORE support of Tb in order to surely rule out unwanted/excess problems. (2) At View/Folders/All, create a "Saved Search Folder" under "Local Folders" psuedo account in Tb. Call "Gmail_Inbox". Saved Search Folder named "Gmail_Inbox" under "Local Folders" : Search Target = Inbox of one Gmail IMAP account in whch pretty many mails are kept. Condition = Match All, Online Search option : Checked
(In reply to WADA from comment #17) > Following is imap log for "Unified Folder" open and "Search Folder" open. > As for "SELECT UNDELED" command use, no difference was observed between > "Saved Search Folder" and "Unified Folder". > (a) Saved Search Folder : Search Target = Inbox of 2 imap > accounts : imap.mail.yahoo.com, imap.gmail.com > Condition = Match > All, > "Online Search" > option : Checked > (b) Unified Folder named Inbox : Search Target = Inbox of all IMAP > accounts + Inbox of all non-IMAP mail account > Condition = Match > All, > "Online Search" > option = Grayed out. Not checked status. > (it seems that Tb > always uses Online Search when Unified Folder) > If Online Search of Search Folder, usually "not Match All" and other > modifier such as "KEYWORD $label1" is added("Tag contains Important" case), > so not so many UID is returned to SEARCH commnd. > There was no difference between "CONDSTORE is enabled" and "CONDSTORE is > disabled". > CONDSTORE is relevant to "CHANGEDSINCE is used or not" upon "uid fetch 1:* > Flags" for resync after SELECT Mbox. > > > 00000003 8:51:01.077 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:SendData: 6 uid SEARCH UNDELETED > > 00000004 8:51:01.327 [2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=1639 needmore=0] > > 00000005 8:51:01.327 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 285 287 288 289 290 293 359 429 430 433 434 500 1121 1132 1136 1142 1143 1146 1150 1157 1168 1179 1189 1202 1204 1206 1208 1209 1212 1213 1214 1215 1216 1217 1218 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1232 1233 1234 1235 1236 1237 1238 1239 1240 1242 1243 1244 1245 1258 1259 1260 1261 1262 1266 1272 1281 1288 1292 1294 1296 1301 1314 1460 1850 1851 1852 1853 1854 1855 185 > > 00000006 8:51:01.327 [2812] 3144[1013d60]: 6 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1876 1877 1878 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 194 > > 00000007 8:51:01.327 [2812] 3144[1013d60]: 0 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 202 > > 00000008 8:51:01.327 [2812] 3144[1013d60]: 4 2025 2026 2027 2028 2029 2030 2031 2032 2033 2078 2088 2117 2130 2150 2151 2181 2297 2372 2383 2384 2385 2386 2396 2397 2400 2401 2402 2403 2404 2405 2406 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 246 > > 00000009 8:51:01.327 [2812] 3144[1013d60]: 5 2466 2467 2468 2469 2470 2471 2472 > > 00000010 8:51:01.327 [2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=27 needmore=0] > > 00000011 8:51:01.327 [2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: 6 OK UID SEARCH completed > > > > 00000017 8:51:01.327 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:SendData: 25 uid SEARCH UNDELETED > > 00000018 8:51:01.562 [2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=806 needmore=0] > > 00000019 8:51:01.562 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 > > 00000020 8:51:01.562 [2812] 3656[1012320]: 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 > > 00000021 8:51:01.562 [2812] 3656[1012320]: 1047 > > 00000022 8:51:01.562 [2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=34 needmore=0] > > 00000023 8:51:01.562 [2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: 25 OK SEARCH completed (Success) > > Yahoo! imap looks to insert new line at "where he wants" instead of "between > two UIDs as done by Gmail imap". > > Do you see your problem with following? > (1) Disable CONDSTORE support of Tb in order to surely rule out > unwanted/excess problems. specifically bug 912216 comment 6 How to disable CONDSTORE support by Tb manually. Disable CONDSTORE support by Tb for all IMAP accounts. mail.server.default.use_condstore = false Disable CONDSTORE support by Tb for each IMAP accountFYI. independently. mail.server.server#.use_condstore = false > (2) At View/Folders/All, create a "Saved Search Folder" under "Local > Folders" psuedo account in Tb. Call "Gmail_Inbox". > Saved Search Folder named "Gmail_Inbox" under "Local Folders" : > Search Target = Inbox of one Gmail IMAP account in whch pretty > many mails are kept. > Condition = Match All, > Online Search option : Checked
Flags: needinfo?(old.square.eyes)
You'll have to forgive me, a mere user. Much of the level of this trouble shooting is beyond me. I did actually read that thread, and Googled how to apply TB patches. How to disable CONDSTORE support by Tb manually. Disable CONDSTORE support by Tb for all IMAP accounts. mail.server.default.use_condstore = false Disable CONDSTORE support by Tb for each IMAP accountFYI. independently. mail.server.server#.use_condstore = false The above doesn't tell me how to do anything. Are you talking about going to the about:config screen? Above are only a couple of settings. There are quite a few more in the patch so I figured it would be more proficient to apply that. Only thing is that I don't know how to do that. Which is why I asked:)
Flags: needinfo?(old.square.eyes)
(In reply to Mark from comment #19) > The above doesn't tell me how to do anything. Are you talking about going to the about:config screen? Yes. In Thunderbird, about:config is carefully hidden, because it's dangerous for general users :-) (Win) Tools -> Options -> Advanced -> General -> Config Editor (Mac) Preference- > Advanced -> General -> Config Editor I want Help->about:about for quick access to about:config :-)
OK thanks for clarifying that. I updated "mail.server.default.use_condstore = false" (I couldn't find any records for the other setting under each server, I tried adding the setting by pasting the full line into the adress bar i.e. "mail.server.server1.use_condstore = false", but that didn't appear to make the record/setting stick). Unfortunately, after a restart of Thunderbird I'm still seeing the same freezing with a "searching folder" and beach ball (OSX).
Saving a search folder is problematic. "Online Search Option" is greyed out. Also when I save/create the search folder, it tells me "You must choose at least one folder to search for the saved search folder." Even though I have already selected the Gmail IMAP inbox.
Actually I got the search folder to work now. I had selected the row, but it was not obvious that the dot/bulletpoint was actually a check box by the folder.
(In reply to Mark from comment #21) > Option not held in mailnews.js is not shown in about:config. To add mail.server.server1.use_condstore = false, you need to do; 1. At Context menu, New -> choose type. "in this case, Boolean, becuse true/flase option. 2. Paste the name, set vlue
OK thanks for that. I have done it. The issue remains. Interesting though that the search folder that I created is very quick at refreshing. It seems to be an issue with the unified folder. FYI this account has 37000 emails.
(In reply to Mark from comment #25) > Interesting though that the search folder that I created is very quick at refreshing. If just after restart, "uid fetch 1:* Flags" + "uid SEARCH UNDELETED" is issued. If refreshing of the Search Folder, "uid SEARCH UNDELETED" only is issued. No problem on the Search Folder just after restart of Tb, or after "go Work Offline, go back Work Online"? > The issue remains. > Interesting though that the search folder that I created is very quick at refreshing. > It seems to be an issue with the unified folder. FYI this account has 37000 emails. If so, cause is perhaps different Inbox. Do you keep big Inbox on other IMAP accounts? How about Inbox of POP3 accounts? How about Inbox of "Local Folders"? As known by Folder Properties of Unified Inbox folder at View/Folder/Unfied, "Unified Inbox" is; (b) Unified Folder named Inbox : Search Target = Inbox of all IMAP accounts + Inbox of all non-IMAP mail account Condition = Match All, "Online Search" option = Grayed out. Not checked status. Create Search Folder for each Search Target Folder of Unfied Inbox. For which folder is your problem observed?
FYI. File/New/Saved Search... can be used to create Search Folder.
Mark, please see questions in comment 26
Flags: needinfo?(old.square.eyes)
It seems to do with Thunderbird and my Gmail IMAP account. The searching folder freeze only happens in unified inbox. Currently I don't use this feature because it interrupts my workflow too much. The experience is that one of two things are happening... either that in unified inbox, Gmail is being checked too long and too often, and/ or the UI locks up while emails are being checked/updated. When not in unified inbox the UI doesn't lock, and the wait/check times are acceptable. Using unified inbox on Android K9 does not have this problem, which makes me think that it's not an account issue. And that it's a Thunderbird unified/UI issue. For the questions above.. No problem on the Search Folder just after restart of Tb, or after "go Work Offline, go back Work Online"? - I don't understand if this is a question. If so, cause is perhaps different Inbox. Do you keep big Inbox on other IMAP accounts? - Define big? I only Sync 30days and messages under 50kb. My Gmail is by far the biggest. How about Inbox of POP3 accounts? - I don't use POP3 currently How about Inbox of "Local Folders"? - No local folders
Flags: needinfo?(old.square.eyes)
How does it behave with version 38 beta from http://www.mozilla.org/en-US/thunderbird/channel/ ?
Flags: needinfo?(old.square.eyes)
Hi, I have been on Beta for a couple of weeks and it makes no difference. Perhaps the lock ups are slightly less frequent, but that might just be me being optimistic.
Flags: needinfo?(old.square.eyes)
This is obviously a long running problem. http://superuser.com/questions/437117/thunderbird-very-slow-with-gmail/923085#923085
Come on guys. I have narrowed this down to be able to cause and solve this problem. In unified inbox, right click on inbox -> properties -> uncheck search online. Then the fun begins. Hitting Update at this point does nothing! Hitting cancel does save the preference though. Until you restart Thunderbird and it's selected itself again!!
(In reply to Mark from comment #29) > > No problem on the Search Folder just after restart of Tb, or after "go Work > Offline, go back Work Online"? - I don't understand if this is a question. It is two questions - No problem on the Search Folder just after starting THunderbird? - No problem on the Search Folder just after "File > Work > Offline, then go back Work Online"? > If so, cause is perhaps different Inbox. > Do you keep big Inbox on other IMAP accounts? - Define big? I only Sync > 30days and messages under 50kb. My Gmail is by far the biggest. number of messages in each Inbox would be a nice start (In reply to Mark from comment #31) > Hi, I have been on Beta for a couple of weeks and it makes no difference. > Perhaps the lock ups are slightly less frequent, but that might just be me > being optimistic. What is your current thinking on this - less frequent? Or no change? We could use a better profile run. Can you get a new profile please? https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G
Flags: needinfo?(old.square.eyes)
Summary: Constant Freezing for minutes at a time with “Searching Folder” in status bar when using unified folders with gmail account → Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar when using unified folders with gmail account
(In reply to Mark from comment #33) > Come on guys. I have narrowed this down to be able to cause and solve this > problem. Indeed you've gone to great lengths. Unfortunately I can't reproduce. And with only 36k messages in your combined inboxes, the obvious way for there to be a performance issue is if any msf files are being rebuilt for the underlying Inboxes. I've updated the instructions at https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G A new profile using the latest version 38 would be a great help
Whiteboard: [closeme 2016-04-01][needs profile]
HI all, I appreciate your work but I cannot spend any more time on this. I have, unfortunately had to move to web based clients as performance was too slow and frustrating for me. Thank you again for your time, I know it's not easy.
Flags: needinfo?(old.square.eyes)
Thanks for the update
Status: UNCONFIRMED → RESOLVED
Closed: 9 years ago
Resolution: --- → INCOMPLETE
Summary: Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar when using unified folders with gmail account → Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar when using unified folders with gmail account on both Mac and Windows
Whiteboard: [closeme 2016-04-01][needs profile] → [needs profile]
Ok, as a newbie experiencing this exact problem, and completely daunted by this long, opaque, and highly technical thread, "I've moved on" is an the answer I was hoping for. Am I to understand that the resolution to this issue is "Don't use Thunderbird"? Is there a summary of this somewhere with guidance for newbies as to how to make this email client usable? A straightforward answer would be most appreciated. Thanks.
(In reply to David Kantor from comment #38) > Ok, as a newbie experiencing this exact problem, and completely daunted by > this long, opaque, and highly technical thread, "I've moved on" is an the > answer I was hoping for. Am I to understand that the resolution to this > issue is "Don't use Thunderbird"? Is there a summary of this somewhere with > guidance for newbies as to how to make this email client usable? A > straightforward answer would be most appreciated. Thanks. start with https://wiki.mozilla.org/Thunderbird:Testing:Memory_Usage_Problems then if you still have trouble please post a support request at https://support.mozilla.org/en-US/questions/new
Ok, I was really hoping for a straightforward answer. That "Memory Usage Problems" is a very daunting, technical document to make new users go through just to get this app working. I don't recall ever having to do that for any of the other email clients I've ever used in the last 20 or so year. I think instead I'm going to look for an email client that works right, so you don't have to be a programmer and go through 25 steps of "Troubleshooting memory usage problems" just to be able to use it to write an email.
BTW those instructions seem to be out of date, contain a lot of information and steps that simply don't reflect reality of where things are and what they're called or if they're even actually available. You shouldn't be sending newbies to waste their time trying to figure them out, it's pointless.
- I'll be happy to take your suggestsions offline. But it intentionally attempts to cover all the possibilities (And yes, a better doc is needed. That takes someone's time.) - If you have interest in staying with Thunderbird, I don't think anyone said you had to go through all the steps. And it is ordered such that the more common issues are at the top. users do what they are motivated to do - but zero effort isn't what we are looking for when trying to help seomeone. > Am I to understand that the resolution to this issue is "Don't use Thunderbird"? I don't see how you reach that conclusion - because clearly multiple people invested a lot of time. Unfortunately we did not find the cause of Mark's issue.
I've been dealing with this issue of Thunderbird (Ubuntu 16.04) freezing up very frequently (anecdotally, whenever I click on it and "really need to use it"), and have been searching endlessly for a solution. I used unified inboxes, and that seems to be where the problem originated in my case. What worked for me (solved going on a week now) was to right-click on the Inbox (underneath it are all the various inboxes that are unified within it), choose Properties, then unselect the checkbox "Search Online". I also went into the global Thunderbird preferences, Advanced tab, General sub-tab, deselect "Enable Global Search and Indexer". Hope this is helpful to others!
Status: RESOLVED → REOPENED
Depends on: 816327
Ever confirmed: true
OS: Windows 7 → All
Resolution: INCOMPLETE → ---
Summary: Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar when using unified folders with gmail account on both Mac and Windows → Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder with gmail account. Workaround unselect the checkbox "Search Online" in unified folder properties.
See Also: → 1611887

I also have a very similar issue and also have a gmail account which I store email in, read, but not deleted. I see exactly the same thing. I get a spinner for several minutes, and it happens constantly.

Following Michael Fisher's recommendation, I disabled the Global Search and Indexer and then stop Thunderbird, remove the global-messages-db.sqlite file from the profile directory, restart Thunderbird, and the problem is now gone.

Thunderbird constantly reads it to refresh something in memory and it can take minutes. What seems to be happening is when this sqlite file gets large, reading it or whatever it's doing, just blocks things for minutes at a time. Perhaps there is a smarter way to use this file to significantly speed things up?

On my system, before I deleted it, it was upwards of 1gb and Thunderbird would freeze for 4-5 minutes, more or less, every few minutes. It definitely froze just after restart, but after about a minute, when I clicked the Unified inbox.

As a comment, this solution of disabling the Global Search and Indexer is also detailed on this page: http://kb.mozillazine.org/Minimize_the_size_of_a_profile

(In reply to Michael Grant from comment #45)

As a comment, this solution of disabling the Global Search and Indexer is also detailed on this page: http://kb.mozillazine.org/Minimize_the_size_of_a_profile

I'm wondering how many messages are in your various Inboxes and other folders for all your accounts? I've been researching this for probably duplicate bug 1611887.

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

For me the global search only caused somewhat annoying background tb activity with tb running 50-100% cpu until everything is re-indexed. The main problem I am looking at is worked-around by disabling the unified folder's "search online". Did you try only disabling the "search online" and leaving global search enabled? If you could try that it would be appreciated but I understand you probably don't want to do that.
What I'm seeing is that when the gmail inbox with lots of messages is searched (as indicated on status line) that the UI hangs, e.g., you can't scroll messages. The time of the hang/lock-up is proportional to the number of message in the Inbox or whichever unified box has lots of messages.
Anyhow, thanks for the info.

From bug 1611887 gene cites https://searchfox.org/comm-central/rev/25df033ac98c8cb346a8e0c338d1e7647ca23bfb/mailnews/base/src/nsMsgXFVirtualFolderDBView.cpp#238

Can someone create a performance profile of this in action? See https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance

Status: REOPENED → NEW
Component: Networking: IMAP → Backend
Summary: Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder with gmail account. Workaround unselect the checkbox "Search Online" in unified folder properties. → Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder. Workaround unselect the checkbox "Search Online" in unified folder properties.

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

(In reply to Brian Haskin (Janzert) - via bug Bug 1611887 - from comment #51)

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

For some reason this is not very revealing.

Do you also see the performance issue when started in safe mode? Start Windows' safe mode with networking enabled

Does problem go away?

It's still there with both windows and thunderbird in safe mode. If anything it's even worse freezing for ~125 seconds. Note though that I did have to switch from wifi to a USB 10/100 Ethernet adapter in order to get networking working with windows safe mode.

See Also: 1611887 → 534520

(In reply to Wayne Mery (:wsmwk) from comment #52)

(In reply to Brian Haskin (Janzert) - via bug Bug 1611887 - from comment #51)

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

For some reason this is not very revealing. [92 seconds of jank with nothing on the stack]

Brian, using a newer version of Thunderbird, please capture another profile. Thanks.

Flags: needinfo?(janzert)

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Flags: needinfo?(mgrant)

Yep, here you go https://share.firefox.dev/3ueQRHl

Doesn't appear to be particularly more informative than the last one though. The freeze does seem to be consistently sub-90 seconds now. Not sure if that's due to changes in Thunderbird or the account though.

Flags: needinfo?(mgrant)
Flags: needinfo?(janzert)

Ack, sorry for the spam. Accidentally cleared an extra needinfo flag.

Flags: needinfo?(mgrant)

(In reply to Wayne Mery (:wsmwk) from comment #55)

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Here you go: https://share.firefox.dev/3sgHN2y

What I did to do this was access the Unified inbox foler. I clicked back to one of the individual folders which took several minutes and then clicked on the Unified inbox which then took several minutes more. The buffer said it over-wrapped.

I see from my settings that I am storing mail in mbox format. I'm going to try and delete everthing and reload my mail with the maildir setting.

Let me know if I can do anything else to move this forward!

Flags: needinfo?(mgrant)

Wow. I've been having this painful issue for 2.5 years on two machines (32GB Macbook Pros). I've searched online for a solution several times during this time and even I've started to seriously consider giving up on Thunderbird after 12 years of using it...

Finally, I've found this thread today. Simply unchecking "Search Online" solves the problem. I don't even understand why I need "Search Online", but it does look like it's not worth having it on. Why is it even enabled by default?

I'm amazed that this issue is 7 years old (and the related issue 534520 is 9 years old) and it still hasn't been solved. Unfortunately, I'm sure there are many power users who stopped using Thunderbird because of this issue.

Last but not least, many thanks for your work and for the workaround.

I'm having the same issue. Thankfully, the workaround Mark found does work (disabling the "Search online" option for the Unified Mail view/folder/search).

I did also find another workaround: Add a "filter" to the Unified Mail view/folder/search, which is narrow enough that your result set remains small.

For example, you can set it to: "Status", "Isn't", "Read". This limits the result set to <100 for me, which makes it load quickly.

I like this workaround better than the "Disable search online" one myself, since this way has a bit less background processing. (doesn't re-query the accounts to check for new messages; that doesn't seem necessary, since Thunderbird already detects when new messages come in, and I've confirmed they then show up in the Unified view)

Side-note: If you do use the "Disable search online" workaround, it can mess with the unread-count for the Unified view. I've found that you can fix that by adding some kind of filter to that view/folder/search -- any filter will do, it seems.

I'm using TB 78.13.0 (32-bit)

This fixed it:

Tools / Options / General / Disk Space - Clear Now

I used Unified folders.
I have left Global Search enabled.

I will just put it in my calendar software to do this "Clear Now" on the first of every month (thanks!).

A while back, I determined to just clear out everything in TB once per month - any e-mail I know I need, I save it, so, everything else can go.

IMO, e-mail programs are not really good for leaving things in, that you want to find later. I determined to leave this to the Windows File Explorer.

(In reply to mb1285 from comment #61)

Wait, now it's doing it again! . . . Well, the Clear Now button is still good to do

It looks like this is what I want:

Tools / Options / General / Indexing / [un-check] Enable Global Search and Indexer

(In reply to Michael Grant from comment #58)

(In reply to Wayne Mery (:wsmwk) from comment #55)

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Here you go: https://share.firefox.dev/3sgHN2y

70% of activity is at "associateView"

Call stack is:

associateView
_applyViewChanges
_enterFolder
open
show
FolderPaneSelectionChange
onselect
EventHandlerNonNull
MozTreeChildren/<
EventListener.handleEvent

(In reply to Brian Haskin (Janzert) from comment #56)

Yep, here you go https://share.firefox.dev/3ueQRHl

Doesn't appear to be particularly more informative than the last one though. The freeze does seem to be consistently sub-90 seconds now. Not sure if that's due to changes in Thunderbird or the account though.

About the same as Michael's - 65% associateView resource:///modules/SearchSpec.jsm

Whiteboard: [needs profile] → [needs new profile]
See Also: → 1757315

Does this still happen in newer versions?
If it does, a new profile will be helpful https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance

Flags: needinfo?(venryx)
Flags: needinfo?(ne715m-7m1f)

Brian, Michael,
Do you still see this issue?

Flags: needinfo?(mgrant)
Flags: needinfo?(janzert)

(In reply to Wayne Mery (:wsmwk) from comment #65)

Does this still happen in newer versions?
If it does, a new profile will be helpful https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance

I am still using Thunderbird (to answer your question in the fwd email). To avoid the freezing issue, I still am using (both of) the workarounds I listed in my last comment: right-clicking the unified-mail "Inbox" entry at the very top of the list on the left, and having "Search Online" disabled, as well as having a filter/search-criteria enabled of "Match any of the following" for "Status -> isn't -> Read".

That said, since I've had those settings enabled for years to avoid the issue, I don't know if the bug still occurs in the latest versions.

So I have tried resetting both of those settings to their defaults (Search Online enabled, and no filters/search-criteria). On doing so, I did have to wait a good ~2 minutes for the app to become responsive again. But maybe that is a one-time thing since I've had it disabled for so long.

So now I will leave it like this for a while and see if the freezing problem occurs going forward.

Okay, the freezing issue happens just a couple minutes after posting my comment above.

  • The freeze lasts for ~70 seconds.
  • What triggers the freeze: When I navigate (ie. click) from showing a specific email's inbox, to the unified "Inbox" entry in the left-panel's list of inboxes.

Here is a permalink to the Firefox profile I took: https://share.firefox.dev/4bczyve

  • I started the profile just before clicking the unified "Inbox" entry. (the freezing occurs something like 3 seconds afterward; in the small period beforehand, I can sometimes still click on an email or two, though I didn't in this case)
  • I stopped the profile a couple seconds after the window became responsive again.
Flags: needinfo?(venryx)

Looks like someone else has already confirmed this and I don't have ready access to an account that shows the issue at the moment.

Flags: needinfo?(janzert)
See Also: → 1830145
Severity: major → S3
Summary: Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder. Workaround unselect the checkbox "Search Online" in unified folder properties. → Constant Freezing for minutes with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder. Workaround unselect the checkbox "Search Online" in unified folder properties. (imap)

(In reply to Stephen Wicklund from comment #68)

Okay, the freezing issue happens just a couple minutes after posting my comment above.

  • The freeze lasts for ~70 seconds.
  • What triggers the freeze: When I navigate (ie. click) from showing a specific email's inbox, to the unified "Inbox" entry in the left-panel's list of inboxes.

Here is a permalink to the Firefox profile I took: https://share.firefox.dev/4bczyve

Thanks for the profile on Windows 10. There is constant activity in the progressSlideX and nsImapMailFolder::NotifySearchHit

Stephen, does this also happen in version 128? Can you do a full profile? It looks like it didn't record all the activity.

status-thunderbird_esr115: --- → affected
Flags: needinfo?(venryx)
Flags: needinfo?(ne715m-7m1f)
Flags: needinfo?(mgrant)

(In reply to Brian Haskin (Janzert) from comment #69)

Looks like someone else has already confirmed this and I don't have ready access to an account that shows the issue at the moment.

If that should change and you can reproduce on version 128 then a new profile would be useful - your earlier profile was largely empty of useful information for some reason.

Severity: S3 → S2
Flags: needinfo?(janzert)
Blocks: 1918961
Flags: needinfo?(janzert)
Whiteboard: [needs new profile] → [needs new profile for 128][has 115 performance profile]

(In reply to Wayne Mery (:wsmwk) from comment #70)

Stephen, does this also happen in version 128? Can you do a full profile? It looks like it didn't record all the activity.

Even better if you can test 128.5.2 next week.

Also, to what extent if any does disabling status bar help? (in View > Toolbars)

(In reply to Stephen Wicklund from comment #60)

I'm having the same issue. Thankfully, the workaround Mark found does work (disabling the "Search online" option for the Unified Mail view/folder/search).

I did also find another workaround: Add a "filter" to the Unified Mail view/folder/search, which is narrow enough that your result set remains small.

For example, you can set it to: "Status", "Isn't", "Read". This limits the result set to <100 for me, which makes it load quickly.

I like this workaround better than the "Disable search online" one myself, since this way has a bit less background processing. (doesn't re-query the accounts to check for new messages; that doesn't seem necessary, since Thunderbird already detects when new messages come in, and I've confirmed they then show up in the Unified view)

Whiteboard: [needs new profile for 128][has 115 performance profile] → [closeme 2025-01-01][needs profile performance for 128][has 115 performance profile]

(In reply to Stephen Wicklund from comment #68)

Okay, the freezing issue happens just a couple minutes after posting my comment above.

  • The freeze lasts for ~70 seconds.
  • What triggers the freeze: When I navigate (ie. click) from showing a specific email's inbox, to the unified "Inbox" entry in the left-panel's list of inboxes.

Thanks Stephen. Are you using version 128, or using beta?

Does the problem change if you do View > Toolbars > untick Status Bar ?

Flags: needinfo?(venryx)

Also, all, please post after using 128.5.2, available later this week hopefully.

Depends on: 1830145
Flags: needinfo?(venryx)

(In reply to Wayne Mery (:wsmwk) from comment #72)

(In reply to Wayne Mery (:wsmwk) from comment #70)

Stephen, does this also happen in version 128? Can you do a full profile? It looks like it didn't record all the activity.

Even better if you can test 128.5.2 next week.

Also, to what extent if any does disabling status bar help? (in View > Toolbars)

(In reply to Stephen Wicklund from comment #60)

I'm having the same issue. Thankfully, the workaround Mark found does work (disabling the "Search online" option for the Unified Mail view/folder/search).

I did also find another workaround: Add a "filter" to the Unified Mail view/folder/search, which is narrow enough that your result set remains small.

For example, you can set it to: "Status", "Isn't", "Read". This limits the result set to <100 for me, which makes it load quickly.

I like this workaround better than the "Disable search online" one myself, since this way has a bit less background processing. (doesn't re-query the accounts to check for new messages; that doesn't seem necessary, since Thunderbird already detects when new messages come in, and I've confirmed they then show up in the Unified view)

I updated to 128.5.2, and tried replicating the freezing issue. I was not able to replicate it, on either my desktop or my laptop. (despite reverting the two "fixes" that I mentioned above for avoiding the freezing)

So for me at least, the bug seems to have been fixed. (I mean, there is still a delay of ~2 seconds on clicking the Unified Inbox, but that seems within the normal range, and is drastically better than freezing for over a minute)

Is anyone else still seeing this issue on the latest version? (128.5.2)

Flags: needinfo?(venryx)

TLDR; 128.5.2 is a vast improvement here.

A couple of months ago I did get a bit of time to start looking into this. To help with that, and for anyone else that wants to look into large inbox behavior in the future, I did set up a docker image with imap inboxes of various sizes. You can find that at https://hub.docker.com/r/janzert/mailbox-size-test

Some local times (w/ profile linked) to open the unified inbox, one account with 1k messages and one...
with 300k messages:

with 100k messages:

A quick perusal of the profiles looks like most if not all the improvement comes from nsMsgSearchSession::AddSearchHit and its underlying use of the mork db improving.

Does anyone who hasn't commented recently still experience problems?

Whiteboard: [closeme 2025-01-01][needs profile performance for 128][has 115 performance profile] → [closeme 2025-01-20 WFM][needs profile performance for 128][has 115 performance profile]

Resolved per whiteboard

Status: NEW → RESOLVED
Closed: 9 years ago → 2 months ago
Resolution: --- → WORKSFORME
Whiteboard: [closeme 2025-01-20 WFM][needs profile performance for 128][has 115 performance profile] → [needs profile performance for 128][has 115 performance profile]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: